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1  Introduction 


In  our  AFOSR  work,  we  have  carried  out  an  extensive  research  program  for  the  study  of  robust 
system  control  using  methodolopes  from  interpolation  theory,  dilation  theory,  and  functional 
analysis.  We  have  slso  become  interested  in  image  processing  and  computer  vision,  and  their 
application  to  visual  tracking  problems. 

First  of  all,  we  devoted  a  large  portion  of  our  research  effort  to  nonlinear  systems.  This  has 
led  us  to  derive  an  iterative  commutant  lifting  theorem  which  gives  an  explicit  design  procedure 
for  nonlinear  systems  and  captures  the  R^^-control  problem  in  the  nonlinear  framework  [51], 
[52],  [53].  We  are  of  course  interested  in  computer  implementations  of  this  work.  In  this  area, 
we  have  defined  a  notion  of  rationality  for  nonlinear  systems,  and  we  have  proven  that  the 
iterative  commutant  lifting  procedure  produces  rational  controllers  (in  this  nonlinear  sense) 
if  we  start  from  rational  data.  The  procedure  has  already  been  applied  to  certain  systems 
(connected  with  the  National  Aerospace  Plane)  with  input  saturations  (in  collaboration  with 
colleagues  at  the  Systems  Research  Center  of  Honeywell  in  Minneapolis).  Moreover,  these 
ideas  are  presently  being  applied  to  a  disturbance  attenuation  problem  in  connection  with 
the  control  of  the  ATB-1000  Testbed  which  models  the  gun  turret  of  the  Apache  helicopter 
(in  collaboration  with  control  engineers  at  the  Picatinny  Arsenal  in  New  Jersey)  [24,  25]. 
This  framework  has  also  led  to  new  directions  in  introducing  notions  of  causality  [54]  in 
commutant  Ufting  theory,  and  moreover  has  led  to  the  possible  formulation  of  a  global  non* 
linear  commutant  lifting  theorem  as  a  saddle-point  result.  We  are  particularly  interested  in 
the  treatment  (and  understanding  the  control  limitations)  of  “hard”  nonlinearities  such  as 
dead-zone,  bacldash,  and  saturation.  These  ideas  will  be  expl^ned  below  in  our  Proposed 
Work. 

During  the  research  period  supported  by  AFOSF  -  J-0024,  we  also  developed  novel  inter¬ 
polation  methods  which  are  not  norm-based.  The  ..ve  arisen  out  of  our  research  into  the 
multivariable  gain  margin  problem  as  weU  as  the  more  general  strvctured  singular  value.  We 
believe  that  this  new  type  of  interpolation  theory  should  lead  to  several  interesting  directions 
in  operator  theory  as  well. 

More  precisely,  our  work  on  the  multivariable  gain  margin  problem,  has  led  to  a  novel 
interpolation  scheme  which  we  call  spectral  Nevanlinna-Pick  interpolation  and  the  more 
general  structured  interpolation  theory;  see  [19],  [18],  [20],  and  [23].  This  involves  matrix 
interpolation  in  which  one  bounds  the  spectral  radius,  and  not  the  norm  of  the  interpolants 
as  in  ordinary  Nevanlinna-Pick  theory.  (Ordinary  Nevanlinna-Pick  is  precisely  the  type  of 
mathematical  problem  that  arises  in  standard  synthesis.)  We  now  have  a  theoretical  pro¬ 
cedure  for  solving  this  spectral  interpolation  problem  both  in  its  pure  matricial  and  tangential 
formulations. 

Our  solution  involves  a  generalization  of  the  commutant  lifting  theorem,  and  a  new  object 
of  interest  in  linear  algebra  and  operator  theory  which  we  call  the  T -spectral  radius.  We 
are  presently  studying  both  the  theoretical  and  practical  ramifications  of  our  solution,  and 
we  would  like  to  develop  software  for  the  computation  of  the  T-spectral  radius.  In  our  new 
research,  we  have  been  concentrating  on  the  generalization  of  these  results  to  the  structured 
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singular  value  of  Doyle  and  Safonov  in  order  to  try  to  develop  an  analytic  /i-synthesis  proce¬ 
dure  [20].  Closely  related  to  this  work  is  a  novel  lifting  technique  which  allows  us  to  study 
the  robust  stability  analysis  of  systems  under  various  kinds  of  structured  perturbations  which 
we  will  consider  below.  (See  also  [13],  [14],  [16],  and  [86].)  This  lifting  technique  allows  one 
to  interpret  the  upper  bound  for  the  structured  singular  value  fi  defined  in  terms  of  certain 
scalings  as  a  structured  singular  value  on  a  larger  space.  Moreover,  we  will  discuss  below 
a  new  approach  for  the  approximation  of  Riemann  mappings  (conformal  equivalences  from 
simply  connected  sub-domains  of  the  complex  plane  to  the  unit  disc)  for  the  application  of 
solving  the  gun-phase  margin  problem  [66]. 

We  have  continued  our  research  on  the  utilization  operator  theoretic  methods  in 
optimization  theory  using  akew  Toeplitz  operators  (see  [17]  for  the  precise  definition),  which 
seem  ideally  suited  for  studying  17*”  design  problems,  especially  for  distributed  (i.e.,  infinite 
dimensional)  systems.  These  methods  are  quite  natural  in  the  control  context  since  they  allow 
one  to  do  design  just  using  the  input /output  operators.  This  has  led  to  an  explicit  solution 
of  the  four  block  problem  for  large  class  of  multivariable  distributed  systems.  (This  is 
the  most  general  -optimization  problem.)  The  procedure  seems  to  be  numerically  robust 
as  evidenced  by  its  implementation  at  the  Systems  Research  Center  of  Honeywell,  and  its 
application  to  a  number  of  distributed  plant  models  including  a  flexible  beam  [70],  and  an 
unstable  delay  system  associated  with  the  flight  control  of  the  X-29  [35].  A  nice  feature  of 
this  approach  is  that  the  complexity  of  the  computations  only  depends  on  the  the  weighting 
matrices  (modelling  the  disturbances)  and  not  on  the  plant  (which  may  be  distributed).  Since 
the  waghting  matrices  are  typically  taken  to  be  rational,  this  approach  seems  very  efficient 
even  in  the  finite  dimensional  case  for  plants  with  large  state  spaces.  We  have  also  been 
developing  methods  for  the  utilization  of  an  operator  due  to  Young  [94]  in  order  to  simplify 
some  of  our  computations  in  the  standard  problem  for  multivariable  systems. 

Recently  there  has  been  a  large  amount  of  work  devoted  to  state  space  approaches  to 
optimization;  see  [3],  [33],  [58]  and  the  references  therein.  In  our  AFOSR  research,  we  have 
verified  a  formula  which  combines  the  state  and  frequency  approaches  to  f ‘"-optimal  design  in 
the  one  block  (sensitivity  minimization)  case  [71],  [96].  We  will  also  be  interested  in  extending 
this  to  the  more  general  two  and  four  block  frameworks.  This  type  of  formula  should  combine 
the  advantages  of  both  the  elegant  state  space  (Riccati  equation)  and  frequency  domain 
(input /output)  approaches  to  theory. 

Next  using  the  one-step  dilation  procedure,  we  have  given  a  way  of  parametrizing  the 
suboptimal  controllers  for  such  generalized  interpolation  problems  [43].  This  has  led  to  a 
scheme  for  designing  suboptimal  finite  dimensional  controllers  for  distributed  systems  in  the 
one  block  setting  [77].  We  would  like  to  continue  this  direction  for  the  general  standard 
problem,  as  well  as  apply  the  techniques  to  a  number  of  design  problems.  Some  steps  in  this 
direction  have  already  been  taken  in  [35],  [70],  and  [72]. 

Closely  related  to  the  above  work  has  been  the  use  of  N*"  techniques  to  study  sampled- 
data  control.  See  [11]  and  the  references  therein.  Here  one  can  use  a  certain  operator-theoretic 
lifting  method  to  describe  a  complete  solution  to  the  analysis  problem  of  verifying  that  a  given 
controller  constrains  the  X^-induced  norm  of  the  sampled-data  system  to  be  less  than  some 
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pre-spediied  level.  (In  fact,  the  lifting  method  is  applicable  to  all  norm  based  optimization 
problems.  In  discrete-time  such  a  technique  was  employed  in  [64]  to  study  a  number  of  issues 
in  robust  control.) 

We  will  also  ^scuss  our  research  in  combined  suboptimal  controllers  ([36]  and 

[38])  as  well  as  sketch  an  approach  for  combining  other  norms  based  on  techniques  from 
inierpolaiion  on  Banach  spaces,  and  the  connection  of  this  methodology  to  a  new  approach 
for  model  reduction  which  we  intend  to  explore  in  our  new  AFOSR  contract. 

We  should  note  that  our  work  in  B^  control  has  also  motivated  a  number  of  interpolation 
theoretic  problems  connected  to  a  strong  version  of  the  Parrott  theorem  [50],  and  the  resulting 
theory  of  minimal  entropy  extensions  [37].  Moreover,  there  are  a  number  of  interesting  oper¬ 
ator  theoretic  problems  connected  to  the  singular  spectrum  of  the  four  block  operator  which 
we  will  describe  in  this  proposal,  and  which  we  intend  to  explore  further.  Finally,  there  are 
some  deep  operator  theoretic  problems  related  to  the  characterization  of  the  optimal  solutions 
in  spectral  interpolation  theory  [18]. 

In  a  different  direction,  we  have  been  using  curve  evolution  theory  (and  especially  invariant 
nonlinear  diffusion  equations),  for  the  development  of  new  algorithms  in  image  processing  and 
computer  vision.  Curve  evolution  theory  has  recently  become  a  major  topic  of  research,  and 
indeed  has  appeared  in  such  diverse  fields  as  differential  geometry,  parabolic  equations  theory, 
numerical  analysis,  computer  vision,  the  viscosity  solutions  of  Hamilton- Jacobi  equations,  and 
image  processing.  See  [67,  68,  69,  81,  82,  83,  84,  85]  and  the  references  therein. 

In  particular,  evolution  equations  which  are  geometric  non-linear  versions  of  the  classical 
heat  equation  have  received  much  attention,  since  these  equations  have  both  theoretical  and 
practical  importance.  These  ideas  have  been  used  also  in  shape-from-shading,  image  smooth¬ 
ing  and  enhancement,  motion  planning,  shape  segmentation,  optical  flow,  and  a  continuous 
implementation  of  mathematical  morphology. 

A  complete  list  of  publications  which  acknowledges  support  of  AFOSR-90-0024  is  included 
in  Section  7.  We  now  sketch  the  work  done  by  A.  Tannenbaum  and  collaborators  on  this 
contract. 

2  Nonlinear  Robust  Control 

We  have  been  pursuing  several  directions  in  order  to  derive  nonlinear  generalizations  of  the 
(linear)  B°^  theory  in  the  weighted  sensitivity  minimization  (one  block),  mixed  sensitivity 
(two  block),  and  even  standard  problem  frameworks.  One  such  direction  is  based  on  an 
iterative  commutant  lifting  theorem  [51],  [52],  [53],  [41]  which  gives  an  explicit  design 
procedure  for  nonlinear  systems  and  captures  the  if'^-control  problem  for  a  large  class  of 
nonlinear  plants.  We  have  also  defined  a  notion  of  rationality  for  nonlinear  systems,  and  we 
have  proven  that  the  iterative  commutant  lifting  procedure  produces  rational  controllers  (in 
this  nonlinear  sense)  if  we  start  from  rational  data  [51].  We  have  thus  been  able  to  write 
computer  code  for  this  procedure  along  the  lines  that  was  done  for  the  four  block  problem 
using  the  theory  of  skew  Toeplitz  operators. 
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2.1  Causal  Analytic  Mappings 

We  consider  saslytic  mappings  on  Hilbert  space.  For  the  precise  definitions  see  [51],  [52],  [53], 
[39].  For  simplicity,  we  will  only  consider  SISO  operators  in  what  follows.  The  multivariable 
case  works  the  same  way  [39].  We  will  find  it  convenient  to  employ  the  Fourier  representation 
of  elements  of 

So  we  consider  an  analytic  map  ^  with  G  =  H  =  (the  standard  Hardy  space  on  the 
disc  D).  Note  that 

H’  ®  ®  “  H\D^) 

where  we  map  (a  in  the  <-th  place)  to  z^,  t  =  1,  •  •  • ,  n.  In  the  usual  way, 

we  say  that  ^  shift-invariant  (or  time-invariant)  if 

^5®"  =  S^  Vn>l, 

where  S  :  -*  denotes  the  canonical  unilateral  right  shift.  (Equivalently,  this  means 

that  5^  =  ^  0  5  on  some  open  ball  about  the  origin  in  which  ^  is  defined.) 

Now  set 

•“  ®  ®  ^  1.  «  >  1. 

where 

P(,)  :=  /  -  5'5*^ 

Then  we  say  that  ^  is  causal  if 

■P(i)^n  =  -PoAPg*/,  i  >  1,  n  >  1. 

For  ^  -*  linear  and  time-invariant,  it  is  easy  to  see  that  ^  is  causal.  In  the 

nonlinear  setting  however,  time-invariance  may  not  imply  causality  [53].  It  is  for  this  reason, 
that  a  causality  constraint  must  be  explicitly  included  for  nonlinear  design. 

2.2  Causal  Optimization  Problem 

Because  of  the  difficulties  involving  causality  when  one  applies  the  classical  commutant  lifting 
theorem  in  the  nonlinear  framework,  we  wiU  need  to  formulate  a  new  linear  causal  opti¬ 
mization  problem.  Then  we  will  indicate  how  to  reduce  the  nonlinear  generalization  of  the 
E"*  sensitivity  minimization  problem  to  a  series  of  such  problems. 

We  let  Sfn)  denote  the  unilateral  shift  on  given  by  multiplication  by  (zi  ■  ■  ■  Zn)- 

Since  will  be  fixed  in  the  discussion  we  will  let  S  :=  5(„).  In  what  follows,  U  will 

denote  the  unilateral  shift  on  given  by  multiplication  by  z,  and  6  €  will  be  an  inner 
function.  Finally  W  :  H\D^)  -»  will  denote  a  causal,  time-invariant  bounded  linear 
operator. 

We  can  now  state  the  caus<d  -optimization  problem  (COP):  Find 

o  :=  inf{||W  -  0Q|1  :  Q  :  -*  H*,  Q  causal,  time-invariant}.  (1) 
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Moreover,  we  want  to  compute  an  optimal,  causal,  time-invariant  Qopt  (uch  that 

a  =  ||W-0Q^ll.  (2) 

If  we  drop  the  causality  constr^t,  the  solution  to  problem  (1)  is  provided  by  the  classical 
commutant  lifting  theorem  [89].  With  the  causality  constraint,  the  solution  to  (COP)  is 
abstractly  provided  by  a  causal  commutant  lifting  theorem  [54],  [42],  [40]. 

Our  constructions  are  based  on  a  reduction  theorem  [39],  which  we  will  briefly  sketch 
below.  In  order  to  formulate  this  result,  we  wiU  first  discuss  the  Fourier  representation. 

Fourier  Representation 

We  need  to  define  all  the  relevant  spaces.  Denote  by 

t=l 

the  Hilbert  space  of  aU  column  vectors 
('  stands  for  tranpose)  such  that 

»=i 

is  finite.  (||  ||  is  our  generic  symbol  for  a  Hilbert  space  norm  (2-norm)  as  well  as  the  induced 
operator  norm.  So  for  example  in  (4),  it  stands  for  the  usual  norm  on  as  well  as  the 
associated  norm  on  Thus  is  a  vector-valued  Hardy  space.  Indeed,  if  f{z)  is 

given  by  (3),  then  we  may  write 

M  =  E  (5) 

m=0 

where  each  Om  is  &Q  infinite  column  vector  with  components  in  C,  and 

ml  ■' 

Clearly, 

ll/ll’  =  E  lll-mll'- 

m=:0 

Conversely,  if  /(s)  €  is  given  in  the  form  (5)  for 

®m  —  [flml *  •  •  •  1  ®mji  •  •  •]  i 

then  f{z)  can  be  written  in  the  form  (3),  i.e., 

/w  =  [/iW..-../,(z),...r. 
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where 


/i(*)  =  £  am,*”*- 

m=0 

In  whnt  follows,  we  will  either  use  representation  (3)  or  (5).  The  context  should  always  make 
the  meaning  clear. 

Next  we  let  5*  :  -*  denote  the  unilateral  shift  defined  by  multiplication  by 

z.  Then  the  Fourier  representation  is  ^ven  by  the  (linear,  bounded)  operator 

§:= 


which  is  defined  by 


/(«)  :=  i{F{zi,Z2,...,2n)) 


:= 

m=0 


Fm,m . m+1 

•^m+2 


(6) 


where 

•  •  •  >  ^  ■^n .•••.«»» ^1*  '  ‘  '  ^n"' 

n.—.««>o 

Note  that  we  are  taking  /(z)  in  the  form  (5)  in  the  above  representation.  Moreover,  note  that 


H^iDn  =  {Fizu...,Zn)  = 


53 

•l 


E  <  “}■ 

*l  »•••!  »»>0 


We  can  also  write 


/(^)  =  [/o,..,o(«),  /i . o(«),  fo.....iiz),  /a...,o(«), . . 


(7) 


where 


OO 

(*)  Xrf  •^n+*»‘i 
msO 


(8) 


Notice,  we  have  chosen  the  indexing  of  the  in  such  a  way  that  the  indices  run  over 

the  set 


in  :=  {(*!,. .M^) :  >  0,  min{ti,...,i„}  =  0}.  (9) 

Next,  it  is  easy  to  prove  that  ♦  :  N*(Z?")  -»  is  unitary,  and  that 

§5  =  5**.  (10) 
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By  (10),  we  see  that  if  W  :  -*  it  such  that  WS  =  UW,  then  the  operator 

Wi*  :  -►  satisfies 


(IV§*)5*  =  WSi*  =  U{Wi*), 


that  is,  Wi*  intertwines  the  shifts  and  V.  Consequently,  it  is  standard  that  Wi*  is 
represented  by  a  row  vector 


[Wo . o(*).  . o{z), . . . ,  . o(z), ...]. 


(11) 


We  will  write  that 


a  |Wo,..,o(2),  . Wc...A‘),  . . .]. 

One  may  show  that  in  fact 

Wi, . M  =  W{z{^  .  .-zir),  (ti, . .  .,tn)  €  /„. 


(12) 

(13) 


The  above  discussion  used  only  the  time-invariance  for  W.  In  the  next  proposition,  we 
will  write  down  an  explicit  expression  for  the  row  vector  of  (13)  associated  with  W9*  in  case 
W  is  causal. 


Proposition  1  Let  W  :  — *  if*  be  time-invariant  Then  W  is  causal  if  and  only  if 

. v(i, . i^)  e  /„ 


By  the  above  discussion  (in  particular.  Proposition  1),  we  see  that  for  W,  0  as  in  the 
(COP)  problem  (1),  we  have 

a  =  inf{||W  -  0QII  :  QS  =  UQ,Q  causal,  time-invariant} 

=  inf{||W#*  -  0O#*||  :  (0#*)5«  =  U{Qi*),Q  causal,  time-invariant} 

=  infdlWi  -  QQ,\\ :  Wi,Q^  :  l\H^)  ^ 

-  l9o . o(*),  zqi . o(*), . . zgo....,i(«),  z^qz . o(*),  •  •  •]}• 

IVom  now  on  (unless  explicitly  stated  otherwise),  we  will  just  work  with  the  operators 
Wi,Q\  :  0{H^)  -♦  Essentially,  via  the  unitary  equivalence  we  are  identifying  the 

spKes  H^{jy')  and  In  particular,  we  identify  W  with  Wi  =  W#*,  and  Q  with 

Qi  =  Qi*.  For  simplicity  of  notation,  we  will  denote 

W  =  Wi,  Q  =  Qi. 

The  context  should  always  make  the  meaning  clear. 
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We  now  translate  the  notions  of  causality  and  time-invariance  for  an  operator  W  : 
-*  H^.  We  will  say  that  W  is  time-invariant  if  W5*  =  UW,  that  is, 


S  [Wo . o(*).  W,.....o(2). ....  Wo...,i(s),  Wa . o(z),  •  •  •]• 


Moreover,  we  say  that  W  is  causal  if  the  operator  Wi  :  is  causal,  which  means 

(see  Proposition  1)  that 


W  S  (Wo^...o(2),  zWt^oi^),  •  •  •  >  zWl..A^),  zV,' ...,o(z), . . .). 

for  some 

m, . 

Motivated  by  the  above  discussion,  for  W  :  0[H^)  — *  time-invariant  and  causal,  we 

introduce  the  operator 


Wc  S  (Wo^...o(^),W,V,o(^),...,WoV.4(z),W|_o(^).-  -] 

=  [Wo . 0(2),  Wi.....o(z)/z, .  .  . ,  Wo . l(z)/z,  W2...,o(z)/z^  . . .]. 


(14) 


Recapping,  in  order  to  solve  the  (COP)  problem  (1),  we  can  equivalently  solve  the  following 
problem:  Given  W  :  -*  IT*  time-invariant  and  causal  as  above,  find 


<7  =  inf{||W  -  0^11  :  QS*  =  UQ,  Q  causal}. 


(15) 


Thus  we  have  to  solve  the  optimization  problem  (COP)  on  the  Fourier  transformed  op¬ 
erators.  But  this  can  be  easily  accomplished  via  the  following  key  result  that  we  proved  in 
[39]. 

Theorem  1  (Reduction  Theorem)  Notation  as  above.  Then 

o  —  inf{||W  -  ©Gll  :  QS  =  UQ,  Q  causal}  (16) 

=  irii{\\[Wo . o(«)  -  ©go . o(^).^(W^.o...,o(^)  -  0gi.o . o(z)),  •  •  .]||  =  (17) 

(ft) . o(z), . . . ,  gj . o(^), . . .]  e  £(/*( *).  R*)} 

=  inf{||W:-0<?|(:g5  =  I7(?}.  (18) 

(Note  in  (17)  the  norm  is  Vie  operator  norm  in  H^).  In  general,  for  Hilbert  spaces 

H  and  K,  Cl(H,K,)  denotes  the  space  of  bounded  linear  operators  from  H  to  K.) 


Algorithm  for  Computation  of  a 

We  would  like  to  summarize  the  above  discussion  with  a  high-level  algorithm  for  the  com¬ 
putation  of  the  optimal  causal  performance  a,  and  corresponding  causal  optimal  interpolant 
Qop*  in  (1)  and  (2). 
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First  of  ail  using  the  notation  of  the  Reduction  Theorem,  let  us  denote 


a„:=  inf{||Wc-0<2l|:<?5  =  fr<?}. 

(See  equation  (18).)  Then  the  Reduction  Theorem  guaramtees  that 


(19) 


a  =  Oo- 


This  means  that  a  causal  optimization  problem  can  be  reduced  to  a  classical  generalized 
interpolation  problem  in  E°°. 

We  can  summarize  the  procedure  as  follows: 

(i)  Let  W,0  be  as  in  (1).  (Thus  W  :  E\D'')  E^  here.)  We  compute  W(zj‘  •••zj,-) 
where  (ii,  ...,*«)€  In-  We  get  that 

W$*  ^  (Wo . o(2),Wi.....o(z)....,Wo . i{z).Wj . o(*),...l, 

and  then  as  above,  we  can  obtain  the  row  matrix 


ItVo . 0(2).  W'f, ....  Wl,Jz), ...]. 


(ii)  The  latter  row  matrix  represents  an  operator  We  :  fi{E^)  -*  E^.  Let  II  :  F’  -► 
E^  0  QE^  denote  orthogonal  projection.  Using  skew  Toeplitz  theory,  we  can  compute 
the  norm  of  the  operator 


A(W,0):=nWe.  (20) 

The  norm  of  this  operator  is  a,  the  optimal  causal  performance. 

(iii)  Using  the  classical  commutant  lifting  theorem  and  skew  Toeplitz  theory,  we  can  compute 
the  optimal  dilation  Be  '  0{E^)  —>  E^  of  A(W,  0).  Recall  this  means  that 

BeS*  =  UBe,  nBc  =  A(W,0),  llBc||  =  ||A(W,0)||  =  a. 

We  can  then  write 

Be  =  We-  eQeft.c- 

Then  from  (14),  we  can  find  the  optimal  causal  dilation 

B  =  W$*  -  0<?ept^*. 

Note  that  B  and  Be  are  related  as  in  (14),  and  similarly  for  Qopt,c  Qapt^*-  Qopt  ■ 
H*(I)'*)  N*  is  the  optimal  causal  interpolant,  i.e., 

a=\\W-eQ^\\. 
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Figure  1:  Sensitivity  Minimization  Configuration 


Nowin  analogy  to  our  previous  work,  we  can  base  an  causa)  iterative  design  procedure 
on  this  chain  of  ideas. 

Here  is  how  such  a  procedure  would  look.  Let  us  call  an  analytic  input /output  operator 
0  ;  admissible  if  is  is  causal,  time-invariant,  and  ^(0)  =  0.  Denote  the  set  of 

admissible  operators  by  Co-  In  what  follows  below,  we  assume  P,W  6  C®,  and  that  W  admits 
an  admissible  inverse. 

Referring  to  Figure  1,  we  consider  the  problem  of  finding 

US  :=  inf  sup  (|[(/  +Po  C)~'  o  W]vl|,  (21) 

^  IMI<« 

where  we  take  the  infimum  over  all  stabilizing  controllers.  (In  what  follows,  we  let  ||  ||  denote 
the  2-norm  ||  Us  on  as  well  as  the  associated  operator  norm.  The  context  will  make  the 
meaning  clear.)  Thus  we  are  looking  at  a  worst  case  disturbance  attenuation  problem  where 
the  energy  of  the  signals  v  is  required  to  be  bounded  by  some  pre-specified  level  6.  (In  the 
linear  case  of  course  since  everything  scales,  we  can  always  without  loss  of  generality  take 
6  =  1.  For  nonlinear  systems,  we  must  specify  the  energy  bound  o  priori.)  Then  one  sees 
that  (21)  is  equivalent  to  the  problem  of  finding  the  problem  of  finding 

US  =  mf.  »iip  IKW'  -Po  q)v(l.  (22) 

«€C.  ||v||<« 

The  iterated  causal  commutant  lifting  procedure  gives  an  approach  for  approximating  a 
solution  to  such  a  problem.  Briefly,  the  idea  is  that  we  write 

W  =  + 

P  =  Pi  +  P2  +  '--, 

q  =  9i  +  92  +  •  •  •  1 
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(23) 


where  Wj,Pj,qj  axe  homogeneous  polynomials  of  degree  j.  Notice  that 
=  6  MJW^-P^q^\\  +  Oi6^), 

qi€n^ 

where  the  latter  norm  is  the  operator  norm  (i.c.,  JST**  norm).  Prom  the  classical  commutant 
lifting  theorem  we  can  find  an  optimal  (linear,  causal,  time-invariant)  qi^  €  such  that 

tif  =  6\\Wi-Piqi,opt\\  +  0{6^).  (24) 

Now  the  iterative  procedure  ^ves  a  way  of  finding  higher  order  corrections  to  this  lin¬ 
earization.  Let  us  illustrate  this  now  with  the  second  order  correction.  Indeed,  having  fixed 
the  linear  part  91, opt  of  q  in  (22),  we  note  that 

Wiv)  -  P{qiv))  -  {Wi  -  Piqi.^){v)  = 

Wb(v)  -  Pj(9i,o|)t(v))  -  Piq2{v)  +  higher  order  terms. 

Regarding  W2,  Pa,  ft  as  linear  operators  on  ®  ^  C)  as  above,  we  see  that 

sup  WiW  -  P  0  9)(i;)  -  [Wi  -  Piqi,„pt)v\\  <  6^\\W2  -  PiftH  4-  0{6^), 

IMI<« 

where  the  “weight”  W2  is  given  by 

W2  ;=  IVa  -  P3(ft,oi>t  ®  ft, opt)- 

The  point  of  the  iterative  causal  commutant  lifting  procedure  is  to  allow  us  to  construct  an 
optimal  admissible  ft, opt,  and  so  on. 

In  short,  instead  of  simply  designing  a  linear  compensator  for  a  linearization  of  the  given 
nonlinear  system,  this  methodology  allows  one  to  explicitly  take  into  account  the  higher  order 
terms  of  the  nonlinear  plant,  and  therefore  increase  the  ball  of  operation  for  the  nonlinear 
controller.  Moreover,  if  the  linear  part  of  the  plant  is  rational,  our  iterative  procedure  may 
be  reduced  to  a  series  of  finite  dimensional  matrix  computations.  (See  [39,  51]  for  discussions 
of  rationality  in  the  nonlinear  framework.) 

Finally,  in  a  number  of  interesting  cases,  the  above  methodology  can  be  extended  to  a 
nonlinear  extension  of  the  mixed  sensitivity  problem;  see  [34].  In  fact,  one  can  show  that 
for  linear  weighting  filters  and  admissible  plant,  the  nonlinear  mixed  sensitivity  problem  may 
be  reduced  to  a  standard  linear  two  block  problem,  followed  by  a  one  block  nonlinear  design, 
which  may  be  solved  using  the  above  iterative  methods. 

Recently  the  above  procedure  was  extended  to  the  general  standard  problem  for  nonlinear 
systemr,  see  [41].  We  should  note  that  we  have  concentrated  on  time-invariant  systems 
in  our  above  description.  In  fact,  there  is  a  much  more  general  causal  commutant  lifting 
methodology  [54,  42,  40]  that  can  be  extended  in  principle  to  time-varying  systems.  This 
is  a  very  important  problem  area.  Moreover,  there  are  interesting  problems  concerning  the 
equality  of  certain  invariants  which  arise  the  the  general  causal  commutant  lifting  framework 
[54]  which  we  intend  to  consider  in  our  upcoming  AFOSR  contract. 
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2.3  Saddle-Point  Approach  to  Nonlinear  Optimization 

We  have  discussed  above  an  iterative  commutant  lifting  approach  to  nonlinear  system  design. 
The  iterative  communtant  lifting  technique  is  basically  a  local  analytic  method  for  nonlinear 
system  synthesis.  We  have  also  been  exploring  a  very  different  approach  applicable  to  certsun 
systems  with  saturations  based  on  an  interpretation  of  the  classical  commutant  lifting  theorem 
as  a  saddle-point  result  [55].  This  motivates  us  to  formulate  a  nonlinear  commutant  lifting 
result  in  such  a  saddle-point,  game- theoretic  framework. 

A  related  approach  to  nonlineu  design  has  already  been  independently  employed  in  the 
novel  and  important  papers  of  Ball- Helton  [8],  [9].  See  also  the  recent  nice  work  in  [59,  60]. 

In  our  research,  instead  of  considering  general  nonlinear  systems  we  limit  ourselves  to 
the  concrete  (but  certunly  interesting  case)  of  linear  systems  with  input  saturations.  Such 
systems  occur,  of  course,  all  the  time  in  “nature.”  We  should  add  that  a  similar  approach 
should  be  valid  for  many  of  the  hard,  memoryless,  noninvertible  nonlinearities  which  appear 
in  control. 

Mathematically,  the  case  of  the  saturation  is  very  interesting  since  in  a  certain  sense  it  is 
a  nonlinear  analogue  of  an  inner  (non- minimum  phase)  element,  whose  “spectrum”  seems  to 
be  spread  throughout  the  unit  circle.  Thus  the  problem  of  sensitivity  minimization  for  such 
elements  (that  is,  a  form  of  weighted  inversion)  is  particularly  challenging,  and  wiU  be  a  key 
topic  to  be  studied  in  our  upcoming  research  program.  Again,  preliminary  results  along  these 
lines  have  been  worked  out  in  [55].  What  needs  to  be  developed  still  is  a  commutant  lifting 
type  result  valid  on  convex  spaces.  This  we  plan  to  do  in  our  new  AFOSR  contract. 

3  Structured  Singular  Values  and  /x-Synthesis 

We  would  like  now  to  discuss  our  work  on  the  structured  singular  value  and  /i-syntbesis  using 
a  novel  approach  which  we  developed  called  structured  interpolation  theory.  The  structured 
singular  value  was  introduced  into  robust  control  by  John  Doyle  and  Michael  Safonov  ([30], 
[31],  [79])  to  handle  problems  involving  structured  perturbations  which  includes  both 
and  the  multivariable  gain  margin  as  special  cases. 

Our  starting  point  is  the  fact  that  the  problem  of  internal  stabilization  of  a  given  LTI 
multivariable  plant  can  be  reduced  to  one  of  interpolation.  Thus  the  natural  measure  of 
robust  performance  in  this  framework  is  given  by  the  minimization  of  the  structured  singular 
values  over  all  possible  interpolants.  Hence,  one  needs  a  structured  Nevanlinna-Pick  type 
result  which  will  generalize  both  the  classical  Nevanlinna-Pick  theorem  (relative  to  the  H°°- 
norm),  as  well  as  the  spectral  Nevanlinna-Pick  theorem  (relative  to  the  spectral  radius).  Such 
a  structured  Nevanlinna-Pick  theorem  can  be  deduced  as  a  consequence  of  a  general  structured 
conunutant  lifting  theorem  as  we  will  indicate  below.  This  approach  has  been  developed  in 
our  AFOSR  sponsored  work  [18,  19,  15, 16,  23, 12]. 

We  wiU  discuss  some  of  these  issues  now,  and  explain  how  these  results  could  serve  as 
a  basis  of  performing  the  /i-synthesis  procedure  in  robust  feedback  control  in  a  rigorous, 
analytical  manner. 
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3.1  Structured  Singular  Values  and  Dilations 

We  would  like  to  formally  introduce  the  structured  singular  value  now,  and  give  some  of 
its  basic  properties.  We  base  this  discussion  on  [20].  Instead  of  working  over  diagonal  sets 
of  matrices  as  in  [30],  we  can  more  generally  work  over  an  arbitrary  finite  dimensional  C*- 
algebra. 

Let  f  be  a  complex  finite-dimensional  Hilbert  space,  and  A  C  C{£)  (the  space  of  bounded 
linear  operators  on  f),  a  C*-algebra.  For  A  €  C{€)t  X  ^  0,  we  define  the  atructund  aingviar 
value 


:=  [inf{||J:|l :  X  €  A,  -1  €  a(AX)}]-'  . 

Moreover,  we  set 

n^{A)  :=  inf{||XAA-*l| :  X  £  A'}, 

where  A'  is  the  commutator  of  A.  Note  that  for  A  =  C{€),  fie^{A)  =  ||A||,  while  for  A  =  CIc, 
Hi^{A)  =  ||A||«p  (the  spectral  radius  of  A). 

We  now  summarize  some  of  the  elementary  properties  of  based  on  Doyle  [30].  The 
relevant  properties  are: 

(i)  n^iA)  =  sup{||AX||^  :  Jir  €  A,  ||Jf ||  <  1}. 

(ii)  /XA  i*  continuous. 

(iii)  /xa(^)  <  MA(i4). 

For  certain  diagonal  algebras  of  matrices,  it  is  argued  in  [30],  [79],  and  [80]  that  the 
structured  singular  value  /xa  is  the  natural  object  of  study  in  robust  control.  Unfortunately 
the  structured  singular  value  is  difficult  to  compute,  so  in  practice  it  is  jxA  which  is  actually 
used  for  control  problems.  It  is  therefore  of  interest  to  know  when  these  two  objects  are  equal. 

In  [30],  Doyle  has  shown  that  in  fact  /xa  =  Ma  when  the  relevant  diagonal  algebra  has  three 
or  fewer  blocks.  In  [20],  we  give  a  very  different  proof  of  this  fact  based  on  the  following  result 
which  we  believe  has  independent  interest.  Define  the  operator  A/x  €  £(£)  by  Ma  •=  AX. 
Notice  that  C{£)  may  be  given  a  Hilbert  space  structure  with  respect  to 

(Ti.rj)  :=rr(T;ri), 


where  Tr  denotes  the  trace.  Define 

/xa(A)  := 


where 

A  :={Mx  :X£  a'}'. 
We  now  have  (see  [20]  for  the  proof): 
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Theorem  2 


MaC-A)  :=  itA{A). 


Note  that  Theorem  8  implies  that  can  be  regarded  as  a  structured  singular  value 
on  a  bigger  space.  fYom  the  theorem  and  property  (ii)  above,  we  can  immediately  infer  the 
key  fact  that  is  continuous.  This  result  is  also  strongly  connected  to  some  recent  work  on 
robust  stability  with  respect  to  time- varying  perturbations  [86].  In  fact,  we  are  investigating 
the  extension  of  this  lifting  technique  to  operators  on  iniinite  dimensional  Hilbert  spaces 
with  applications  to  the  robust  stability  analysis  of  systems  under  various  kinds  of  structured 
perturbations  [13].  In  particular,  we  have  considered  the  following  two  cases  [13, 14,  21]: 

(i)  The  algebra  of  constant  diagonal  scales  A\  with  the  operator  A  taken  to  be  analytic 
Toeplitz.  (This  is  the  case  analyzed  in  [86].)  Note  that  by  “analytic  Toeplitz  operator” 
A,  we  mean  that  A  is  given  by  an  n  x  n  matrix  with  entries  functions,  which  we 
regard  as  acting  as  a  multiplication  operator  on  H^(C”).  Thus  A  defines  a  stable  LTI 
system.  We  also  want  to  consider  general  time-varying  linear  input-output  operators 
with  this  constant  diagonal  algebra  of  scalings  as  well. 

(ii)  Again  we  take  A  to  be  analytic  Toeplitz,  but  now  we  want  to  consider  A'  to  be  the 
algebra  of  diagonal  analytic  Toeplitz  operators.  This  is  the  type  of  problem  considered 
in  /i-synthesis. 

We  should  note  that  this  work  has  also  led  to  a  new  relative  Toeplitz-Haxudorff  theorem. 

We  will  now  outline  a  structured  analogue  of  the  commutant  lifting  theorem  [20].  This 
will  be  applied  to  the  structured  version  of  classical  matricial  Nevanlinna-Pick  interpolation 
below. 

Set 

T  :=  5(m)  0  Ig 

where  m  is  a  finite  Blaschke  product,  5(m)  is  the  compressed  shift,  and  f  is  a  finite  dimen¬ 
sional  complex  Hilbert  space.  Fix  A  C  a  C7*-algebra.  Define 

Iff!  0  A  :=  {I}ii  ®X:X^  A}, 

Iin  ®  A'  :=  {Ijp^X.X^  A'}. 

Notice  that  H  :=  reduces  both  Ijjt  ®  A  and  /if.®  A'.  Now  define  for 

A  €  {T}'  (the  commutant  of  T), 

p^{A)  :=  inf{||A-AA-^|| :  X  invertible,  X  €  {T}',  X  £  {Ifp  ®  A|^)'}. 

Let  U  be  the  isometric  dilation  of  T  on  H^{€)  (so  that  U  is  defined  by  multiplication  by 
z).  For  B  £  {V}\  define 

p^(5)  :=  inf{|irHy-^||  :  Y  invertible,  Y  £  {I/}',  F  €  (/».  ®  A)'}. 

We  can  now  state  the  following  result  from  [20]: 
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Theorem  S  (StructurcMl  Commutant  Lifting  Theorem)  Notation  as  above.  Then  for 

item', 

f^{A)  =  inf{p^(B)  iB  is  a  commuting  dilation  of  A}. 

Actually,  in  the  finite  dimensional  case  of  interest  to  us,  we  can  show  that 

=  i^suppA(B(2)) 

where  B  €  {U}'  is  a  commuting  rational  dilation  of  A. 

3.2  Structured  Nevanlinna-Pick  Interpolation 

We  now  apply  the  above  theory  to  a  structured  version  of  the  Nevanlinna-Pick  interpolation 
problem  for  matrix- valued  interpolants. 

Let  ^  be  a  finite  dimensional  Hilbert  space,  let  zi,...,Zn  €  D  be  distinct,  and  let 
Fi,...,Fn£  C(C).  We  begin  with  the  classical  matricial  Nevanlinna-Pick  problem  in  which  we 
want  necessary  and  sufficient  conditions  for  the  existence  of  an  analytic  function  F  :  D  C{€) 
with  yp'lloo  <  1  such  that 

F(zj)  =  Fj  (25) 

for  j  =  Define 


and 

n:=  H\e)emH\e). 

We  set  T  :=  S{m)  0  Is,  and  note  that 

W  =  /i®f +  /3®^ +  •••  +  /„ 

This  sum  is  direct  but  not  orthogonal. 

For  the  given  interpolation  data  above,  we  define  A  :  7f  -»  7f  by  linearity  and  by 

for  all  f  €  f,  i  =  1,2, . .  .,n.  Note  that 

for  all  f  e  f ,  j  =  1, 2, . . . ,  n.  Thus 

A  e  {Ty. 
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It  it  eaty  to  show  that  F  tatitfies  the  interpolation  conditions 

F{zi)  =  Fi,  Vi  =  l . n  (26) 

if  and  only  if 

PhMf  -  APji, 

where  Afjp  :  B^{€)  -*  denotes  the  multiplication  operator  associated  to  F.  Then 

the  classical  commutant  lifting  theorem  implies  that  there  exists  an  F  satisfying  (26)  and 
ll-^lloo  <  1  if  and  only  if  ||v4||  <  1.  We  will  now  show  that  the  structured  Nevanlinna-Pich 
problem  can  be  pven  a  similar  solution,  based  on  the  structured  commutant  lifting  theorem. 
More  precisely,  define 

I  :=  {F  :  D  -*  £(S) :  F  is  rational,  bounded  in  D,  F{zj)  =  Fj). 

We  are  interested  in  finding 

/i(I)  :=  inf  {sup  n/i{F{z))  :F  el) 

*€D 

ii{I)  ;=  inf{sup/iA(P’(«))  :F  el). 

*€i3 

We  denote  the  operator  A  associated  with  the  matrices  Fi,  • . . ,  Pn  by  i4(Fi, . . . ,  Fn).  Set 
PriA)  = 

inf{|1.4(MiFiArf' . MnFnM-^)\\  :  M,  €  A',  1  <  j  <  n} 

(where  the  Mj  are  Invertible)  and 

PtM^)  = 

sup{pT(>l(Fi JTi, . . . ,  FnJTn)) :  WAiXu . . . X„)||  <  1,  JTa, . . . ,  €  A), 

where  as  above,  for  an  operator  Q  e  {T}'  we  let 

Pt{,Q)  =  inf{|lJrQX-^l|  :  X  is  invertible  and  X  €  {T}'  }• 

It  is  easy  to  show  that 

Pt(^)  ^  PT.a{A). 

We  can  now  state  [20]: 

Theorem  4  (Structured  Nevanlinna-Pick)  Notation  as  above.  Then 
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Theorem  5  Notation  05  a6ove.  Then 


Next  in  many  control  problems  one  is  interMted  in  a  variant  of  Nevanlinna-Pick  inter¬ 
polation,  called  tangential  Nevanlinna-Pick  interpolation.  In  the  tangential  problem,  we  are 
pven  5i, . . . , 2n  €  D  (which  we  take  to  be  distinct  for  simplicity),  ui, . . . , ii„  C  non-sero 
vectors,  and  vi,...,Vn  €  arbitrary  vectors.  We  are  then  interested  in  those  bounded 
analytic  functions  F  :  D  -*  C{C^)  which  satisfy  the  interpolation  conditions 

F{xj)uj  =  Vj,  i  =  1, . . . ,  n.  (27) 

In  the  classical  Nevanlinna-Pick  problem,  we  ask  for  conditions  guaranteeing  the  existence  of 
an  interpolating  function  F  with 


\\F\\oo  :=  sup{|lF(z)|l:5  6D}<l. 

In  [15],  we  study  the  spectral  version  in  which  we  require 

lip'll^  :=  sup{||P*(z)|U  :z€D}<l. 
Define  the  tangential  NevanlinnarPick  matrix  as  follows  (for  p  >  0): 

{pVj.P^k)  -  {Uj,Vk) 


tti,  wi; . . «n,  Vnip)  := 


1  -  IjZk 


l<j,k<n 


The  following  result  may  be  deduced  as  a  corollary  of  a  tangential  spectral  commutant  lifting 
theorem  [15]: 


Theorem  6  (Tangential  Nevanlinna-Pick  Theorem)  There  exists  F  £  ^""(C^)  roith 
<  P  zotisfying  the  interpolation  conditions  (21)  if  and  only  if  there  exist  Xj  £  B{C^) 
(1-^3  invertible  such  that 

•  •  • » •  •  •  t  XfiVjn’y  p)  >  0. 


Work  is  already  in  progress  on  the  tvio-sided  and  bitangeniial  spectral  and  structured 
analogues  of  the  classical  results  [12].  These  results  are  precisely  what  are  needed  for  a 
completely  rigorous  p-synthesis  procedure  in  robust  control. 
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S.S  Conformal  Mappings 

Wt  nonld  like  to  briefly  ducau  lome  work  that  we  also  did  on  the  gain- phase  margin  problem 
that  involves  some  novel  approximation  methods  of  Riemann  mappings  (conformal  equiva¬ 
lences  from  a  simply  connected  proper  subset  of  C  to  the  unit  disc)  due  to  Marshall-Morrow 
(see  [27]  and  the  references  therein). 

The  successful  sdution  of  the  gain  and  phase  margin  problems  (see  [90],  [66],  [32])  was 
based  on  the  fact  that  one  could  explicitly  construct  a  coi^ormal  equivalence  from  a  simply 
connected  subdomain  of  C  (which  was  associated  to  the  uncertainty  model)  to  the  disc. 
Nevanlinna-Pick  interpolation  then  took  care  of  the  rest.  In  [66],  we  considered  a  combination 
of  both  the  classical  gain  and  phase  margins  in  order  to  arrive  at  a  better  measure  of  robust 
stability  which  we  called  the  gain-phase  margin.  Unfortunately,  in  this  case,  there  is  no 
explicitly  computable  conformal  equivalence  between  the  associated  domain  of  uncertainty 
and  the  disc.  The  algorithm  of  Marshall- Morrow  however  gives  a  fast  way  of  approximating 
the  (pven  equivalence,  and  has  led  to  a  reliable  approximate  solution  of  gain-phase  margin  in 
[27].  We  are  now  applying  this  algorithm  to  the  type  of  general  robust  synthesis  question  as 
considered  by  Sideris  and  Safonov  in  [87]. 

3.4  Problems  in  Classicnl  Interpolation  Theory 

We  would  like  to  mention  a  direction  in  our  research  which  involves  some  interesting  problems 
in  classical  interpolation  theory,  in  particular,  the  minimal  entropy  solutions  for  a  number  of 
interpolation  problems  [50],  [37].  We  have  found  that  in  studying  the  spectral  properties  of 
the  four  block  operator  and  its  relation  to  interpolation  theory,  we  have  been  led  to  a  strong 
version  of  the  classical  Parrott’s  theorem.  Parrott’s  theorem  is  one  of  the  key  matrix 
extension  results  and  has  found  numerous  uses  in  control  theory  as  well  as  signal  processing. 
Our  strengthened  version  in  a  certain  sense  picks  out  an  extension  which  is  “opposite”  to 
the  famous  maximal  entropy  or  central  solution  to  such  extension  problems.  This  solution 
has  a  natural  physical  interpretation  in  the  waves  through  multi-layered  media  context. 
FVom  the  more  theoretical  side,  this  result  can  be  used  in  generalizing  some  beautiful  results 
of  Adamjan-Arov-Krein  on  the  connection  of  the  singular  values  of  the  Hankel  operator  to 
optimal  interpolation  by  functions  with  a  presribed  number  of  poles  on  the  unit  disc  to  the 
four  block  operator  of  control  [46]. 

Further,  based  on  the  strong  Parrott  theorem  we  have  proven  a  strong  version  of  the 
commutant  lifting  theorem  [37]  which  leads  to  an  explicit  parametrization  of  minimal  en¬ 
tropy  s<flutions  in  dilation  theory.  We  would  like  to  apply  this  to  the  Nevanlinna-Pick  and 
Cpxatheodory  interpolation  problems  (and  even  to  the  general  standard  problem),  in 
order  to  explore  the  system  theoretic  consequences  of  this  class  of  dilations. 

4  Optimization  of  Distributed  Systems 

In  [73],  [74]  we  have  considered  the  mixed  sensitivity  i7”°-optimization  problem  for  distributed 
plants  with  a  finite  number  of  unstable  poles. 
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Figure  2:  Standard  Feedbaick  Configuration 


As  in  the  standard  operator  approach  to  such  problems,  the  computation  of  the  optimal 
performance  and  corresponding  optimal  controller  is  reduced  to  a  finite  dimensional  matrix 
problem.  In  the  stable  case,  the  size  of  the  matrix  only  depends  on  the  McMillan  degree 
of  the  weighting  filters.  In  the  case  of  unstable  plants,  the  size  of  the  corresponding  matrix 
depends  on  the  number  of  right  half  plane  poles  of  the  plant  as  well.  The  dimension  of  this 
matrix  can  be  computed  a  priori  The  key  mathematical  fact  that  we  use  is  that  the  skew 
Toeplitz  operators  which  we  obtain  in  the  unstable  case  are  finite  rank  perturbations  of  the 
classical  skew  Toeplitz  operators  obtained  from  compressions  of  rational  functions. 

In  our  AFOSR  research,  we  have  used  these  techniques  to  synthesize  controllers  for  several 
types  of  flexible  structures  [70],  and  an  unstable  delay  system  derived  from  the  flight  control 
oftheX-29  [35]. 


4.1  Two  Block  Problems  With  Unstable  Plant 

In  this  section,  we  will  show  that  several  two  block  ir°°-mixiimization  problems  reduce  to  the 
computation  of  the  norm  of  a  certain  skew  Toeplitz  operator,  and  indicate  how  this  norm 
may  be  computed.  We  begin  with  some  notation.  The  Hardy  spaces  and  are  defined 
on  the  unit  disc  as  above.  We  denote 

RE^  :=  {rational  functions  in  . 

We  consider  the  feedback  configuration  of  Figure  2  with 


and  Gn  €  JT*.  G4  €  RE". 

We  assume  that  (i)  =  rrinG,u>,  where  rrin  €  E"  is  inner  (arbitrary)  and  Gno  6  E" 

is  outer,  and  (ii)  Gn,  Gi  have  no  common  zeros  in  the  closed  unit  disc.  We  also  write 
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Gi  =  tn^Gio  where  €  RH^  is  inner  and  Gjo  €  RH°°  is  outer.  Under  these  assumptions 
there  exist  X  €  RH^  and  Y  6  fT"  such  that 


XGn-^YGd  =  l.  (28) 

(To  construct  solutions  of  (28),  X  must  be  chosen  to  satisfy  a  set  of  interpolation  constraints 
at  the  MToe  of  G4  in  the  dos^  unit  disc  so  that  V  =  (1  -  XGn)/Gd  belongs  to  H^.  Since 
the  constraints  are  finite  in  number,  X  can  always  be  chosen  to  be  rational.)  The  set  of  all 
contrdlers  which  stabilize  the  plant  can  now  be  written  in  the  form 

^~Y-QGn 

for  some  Q  £  Now  let  5  :=  (1  +  PC}~^  and  note  that 


5=1-  XGn  -  QGnGd. 


(29) 


In  [73],  [74],  we  show  that  the  computation  of 


inf 

•tabiliunc  C 


V/xS 

WiiS  -  1) 


where  Wit  €  JZiT**  are  given  weighting  functions  with  IVf  W{^  £  RH"^  may  be  reduced 
to  computing  the  norm  of  the  operator 


A:= 


PH(m,){w^o(S)-Wo(S)m(S)) 

Go{S) 


(30) 


where  S  :  JJ*  — »  if*  denotes  the  unilateral  shift,  H{m^)  :=  N*  0  mt,H^  and  P^(n^)  the 
orthogonal  projection  onto  B{my),  for  m,Tn«  inner  functions  assodated  to  the  plant  and 
weighting  filters,  and  where  Wq,  Wq,  Go  are  rational  functions  computed  from  the  plant 
and  weighting  filters.  This  reduction  is  true  for  plants  with  arbitrary  outer  parts.  (We  can 
do  a  similar  type  of  reduction  for  another  two  block  minimization  problem  in  case  the  outer 
part  of  the  numerator  of  the  plant  is  rational.  Namely,  in  this  problem  we  are  required  to 


find 


H  =  inf 

•t«biliEiii(  C 


WiS 

W2CS  ’ 


where  Wi,  W3  6  RE*”  are  given  weighting  functions  with  Wj'*,  G  RH’^.) 

In  [73],  [74],  we  develop  an  approach  to  computing  the  singular  values  and  vectors  of 
operators  of  the  form  (30).  We  remark  here  that  it  is  easy  to  compute  the  essential  norm 
(see  [73],  [74])  of  the  operator  A,  which  will  be  denoted  by  jlAjjc.  Then  in  [74],  the  following 
result  is  proven: 


Theorem  7  Let  n  denote  the  maximum  of  the  McMillan  degrees  of  the  weighting  filters  Wi 
and  W2,  and  let  i  denote  the  number  of  unstable  poles  of  the  plant  P.  Then  the  singular 
vectors  and  values  of  A  which  are  >  ||A|je  may  be  derived  from  an  explicitly  computable 
system  ofZn  +  21  linear  equations  (the  “singular  system"). 
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In  [74],  the  singular  system  of  equations  is  explicitly  written  down.  Again  the  number 
of  equations  only  depends  on  the  McMillan  degrees  of  the  weighting  iUters,  and  the  number 
of  right  half  plane  poles  of  the  plant.  The  computation  of  the  maximal  singular  value  and 
the  associated  singular  vectors  of  A,  then  allows  us  to  find  the  optimal  performance  fi  of  our 
original  control  problem  and  the  corresponding  optimal  compensator. 

As  an  example  of  the  above,  consider  the  plant  (in  continuous  time)  with  a  delay  and  one 
unstable  pole: 


P(a)  =  e-** 


os  +  1 
os  -  \  ' 


The  optimal  unweighted  mixed  sensitivity  performance  can  be  computed  to  be 


It  is  interesting  to  note  that  as  h  oo,  and/or  a  -»  0,  the  best  achievable  performance 
increases  exponentially,  as  expected.  In  [35],  a  more  complicated  (and  realistic)  delay  problem 
is  worked  out  using  the  above  methods. 

Of  course,  we  would  now  like  to  extend  the  above  techniques  to  unstable  distributed 
multivariable  plants  in  the  full  four  block  setting.  Research  is  now  proceeding  along  these 
directions  in  our  new  AFOSR  contract.  Moreover,  we  are  very  interested  in  working  out 
more  benchmark  examples  in  addition  to  the  flight  control  problem  [35]  and  flexible  beam 
problem  [70]  to  which  we  alluded  above.  A  key  part  of  the  implementation  will  be  to  have 
an  efficient  way  of  generating  sub>optimal  finite  dimensional  compensators  for  such  problems. 
This  important  area  is  also  being  investigated. 


4.2  Young’s  Operator 

A  key  diflSculty  involved  in  reducing  the  standard  problem  to  the  four  block  problem  is  the 
various  kinds  of  factorizations  that  must  be  performed.  In  fact,  one  of  the  major  advantages 
involved  in  the  recent  state  space  methods  [33]  is  that  these  factorizations  may  be  avoided. 
Of  course  as  mentioned  above,  one  of  the  disadvantages  of  these  state  ty^e  methods  is  that 
their  practical  applicability  to  distributed  systems  seems  to  be  very  difficult.  (On  an  infinite 
dimensional  state  space  one  gets  infinite  dimensional,  i.e.,  operator  valued  Riccati  equations. 
See  [28,  29].) 

We  have  recently  begun  developing  a  technique  which  would  avoid  a  number  of  the  prob¬ 
lems  with  such  factorizations  (especially  in  the  multivariable  distributed  case  [75]),  as  well 
as  allow  the  utilization  of  our  frequency  domain  "skew  Toeplitz”  methods  to  distributed  sys¬ 
tems.  First  of  all,  recall  that  via  the  Youla  parametrization,  the  standard  problem  may  be 
formulated  as  finding 

where  Ti,72,T3,Q  are  matrix- valued  S'”  functions  of  compatible  sizes.  More  precisely,  let 
£i,Ti  denote  finite  dimensional  complex  Hilbert  spaces  for  i  =  1,2.  Then  we  take  Ti  € 
iJ*(^i,^2),  Ta  €  Ti  £  and  the  parameter  Q  €  H~(.Fi,.Fj).  (In 


21 


general,  for  two  complex  separable  Hilbert  spaces  we  define  to  be  the  space 

of  aU  uniformly  bounded  analytic  functions  in  the  open  unit  disc,  whose  values  are  operators 
from  £  to  ^.)  We  assume  that  Tj  is  inner,  and  that  T3  is  co-inner. 

Define 

Wj  :=  L\£2)eTiH\T2), 

where  i«  the  orthogonal  complement  of  in  Define  the  operator  (see 

[94],  [36])  A  :  Wi  -»  «a  by 

A/  :=  PH,Ta/ 

where  denotes  orthogonal  projection  on  Hi-  Then  using  the  commutant  lifting  theorem, 
one  may  show  that 

^W^llTx-r3gT3llco  =  llA||. 

We  would  like  to  be  able  to  compute  the  optimal  performance  and  parametrize  the  optimal 
compensators  directly  from  the  Young  operator  along  the  lines  of  the  methods  that  we  followed 
for  the  four  block  problem  [44],  [45],  [75].  To  do  this  would  be  a  great  advantage  since  we 
would  no  longer  have  to  go  through  the  messy  transformation  of  the  standard  problem  to 
the  four  block  form.  We  are  now  developing  a  straightforward  way  of  computing  the 
optimal  performance  and  compensators  with  the  Young  operator  based  on  a  certain  triangular 
representation  of  the  operator. 

4.3  Mixed  Norm  Suboptimal  Controllers 

One  of  the  main  themes  in  modem  control  theory  is  the  utilization  of  norm  based  criteria  to 
measure  the  optimal  performance  of  a  given  control  system.  (See  [32]  for  detailed  discussions 
on  this  topic.)  Two  of  the  most  important  norms  employed  in  modem  control  analysis  and 
design  are  the  J7^-norm  and  the  ir°°-norm.  Indeed,  the  J7^-norm  is  the  basis  of  classical 
quadratic  optimal  control,  while  the  E^-norm  appears  in  modem  robust  synthesis  (and 
implicitly  in  the  more  classical  loop  shaping  methods  [32]). 

We  have  been  investigating  combining  the  advantages  of  both  E^  and  control  in  [38]. 
(See  also  [36],  [65])  for  extensive  lists  of  references  on  various  approaches  to  mixed  norm 
control.)  Our  starting  point  is  a  nice  result  of  Kaftal^Larson- Weiss  [62]  which  guarantees 
the  existence  of  an  interpolant  which  simultaneously  satisfies  an  17°°  and  E^  suboptimality 
criterion.  Using  the  theory  described  in  [43]  on  suboptimal  J7°°  interpolants,  we  can  then 
give  an  explicit  way  of  computing  the  combined  E'^-E^  suboptimal  interpolant  in  a  given 
F°°  problem. 

More  precisely,  for  c  e  l/°",  set  deo(c)  :=  distance(c,  JI°°),  and  d2{c)  :=  distance(c,  .ff *). 
(Note  that  all  of  our  Hardy  spaces  are  defined  on  the  unit  disc  here.)  Then  for  any  ^  >  1,  it 
is  proven  in  [62]  that  there  exists  ^  6  ir°°  such  that 

l|c-#IU<W„W.  (31) 
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In  CMe,  m,  w  €  H’”  with  m  inner,  and  w  =  p/q  rational,  using  skew  Toeplitz  theory  [38] 
one  may  explicitly  construct  i.e.,  if  c  :=  mw,  then  we  can  find  4  €  satisfying 

||Wtn-^||oo<  Woo(c),  l|?nu,-0||a<^^.  (32) 

Indeed,  let  p  :=  jdoe(c),  and  let 

K  ■=pMTrq{T)-p{TypiT) 


be  a  skew  Toeplitz  operator.  Let  gg  denote  the  function  in  H"*  defined  by 

gs  :=  «’doo(c)M;^9(T)*(l  -  m^^ioo)). 

Then  the  function 

w-m(f>=Bs=  -  - 

mm(0)  +  9(T)s< 

satisfies  (32).  Explicitly,  ^  =  -lK(Bs  -  w)  £  H°°  and 


(33) 

(34) 


||u;  -  m^lloo  <  Woo,  Hw-m^lla  < 

The  skew  Toeplitz  approach  is  the  only  procedure  of  which  we  are  aware  to  compute  a  4> 
satisfying  (32)  when  m  is  irrational.  Further,  let  n  :=  max{degree  p,  degree  9}.  Then,  if  m 
is  Blaschke  product  of  order  k  where  n  is  small  and  k  is  large,  the  methodology  just  outlined 
provides  a  numerically  efficient  method  for  computing  the  function  ^  satisfying  the  Kaftal- 
Larson-Weiss  constraints  (32).  However,  if  this  is  not  the  case  and  m  is  rational,  then  the 
state  space  methods  in  [36]  to  compute  a  ^  satisfying  (32)  may  be  more  efficient. 

Since  as  it  turns  out  that  the  combined  H^-H^  interpolant  is  a  central  solution,  these 
interpolants  are  well-known  to  be  numerically  robust,  and  leads  to  an  interesting  class  of 
combined  controUers  for  feedback  systems.  We  are  now  actively  investigating  the 

properties  of  these  controllers,  as  well  as  extending  these  results  to  find  a  computational 
procedure  for  the  frill  standard  problem  setting  for  distributed  MIMO  systems. 

Further,  we  have  found  a  new  method  for  constructing  the  central  solutions  as  related 
to  the  general  standard  problem  in  the  multivariable  case.  We  are  now  in  the  process 
of  exploiting  this  technique  for  the  explicit  parametrization  of  the  suboptimal  controllers  for 
multivariable  distributed  systems.  This  would  pve  a  powerful  alternative  method  to  the 
one-step  extension  techniques  we  have  been  previously  using. 

Finally,  we  are  interested  in  combining  other  types  of  norms  in  control,  for  example,  and 

A  possible  method  for  doing  this  can  be  based  on  some  new  results  on  interpolation  in 
Banach  spaces  due  to  Pisier  [78]  and  Janson  [61].  In  fact,  this  methodology  can  also  have 
some  nice  applications  to  model  reduction  (relative  to  “best”  Hankel  norm  approximations), 
which  is  certainly  a  direction  which  we  intend  to  explore. 
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5  Image  Processing  and  Computer  Vision 


We  have  been  doing  extensive  research  into  image  processing  and  computer  vision,  and  the 
use  of  these  methodologies  in  visual  tracking.  We  are  very  interested  in  understanding  how  to 
use  visual  information  in  a  feedback  loop.  In  order  to  give  the  reader  a  flavor  of  this  work,  we 
will  concentrate  on  a  theory  of  scale-space  that  we  developed  for  planar  shapes  [81,  82].  In  this 
work,  we  combine  the  three  important  theories  of  scale-spaces,  afflne  invariant  descriptors, 
and  curve  evolution,  in  order  to  define  a  new  afllne  invariant  scale-space  for  plane  curves.  This 
scale-space  is  obtained  from  the  solution  of  a  novel  curve  flow,  which  admits  affine  invariant 
solutions.  Our  other  work  in  vision  covers  a  new  theory  of  shape  [67,  68,  69],  as  well  as  new 
methods  for  afiine  invariant  image  processing  and  analysis  [83,  84,  85]. 

Multi-scale  descriptions  of  signals  have  been  studied  for  several  years  already.  A  possible 
formalism  for  this  topic  comes  from  the  idea  of  multi-scale  filtering  which  was  introduced 
by  Witkin  [93],  and  developed  in  several  different  frameworks  by  a  number  of  researchers  in 
the  past  decade.  The  idea  of  scale-space  filtering  is  very  simple  and  can  be  formulated  as 
follows:  Given  an  initial  signal  9o(X)  :  R"  -*  R”*,  the  scale-space  is  obtained  by  filtering  it 
with  a  kernel  K(X,t)  :  R"  -*  R"*,  where  t  £  R"*"  represents  the  scale.  In  other  words,  the 
scale-space  is  given  by  defined  as 

(35) 


where  represents  the  action  of  the  filter  Larger  values  of  t  correspond  to 

images  at  coarser  resolutions. 

It  is  important  to  note  that  not  every  kernel  can  be  used  in  defining  a  scale-space.  Indeed, 
several  conditions  need  to  be  imposed  on  the  signal  (and  therefore  on  the  filter¬ 

ing  operation  (35)).  One  of  the  most  important  is  that  of  causality,  which  states  that  no 
“information”  is  created  when  moving  from  fine  to  coarse  scales. 

A  famous  example  of  a  kernel  which  satisfies  the  required  conditions  is  the  Gaussian  kernel. 
In  this  case,  the  scale-space  is  linear,  and  the  filter  in  (35)  is  just  defined  by  convolution.  The 
Gaussian  kernel  is  one  of  the  most  studied  in  the  theory  of  scale-spaces.  It  has  some  very 
interesting  properties,  one  of  them  being  that  the  signal  obtained  from  it,  is  the  solution 
of  the  heat  equation  (with  as  initial  condition)  given  by 


dt 


=  A9. 


(For  more  details  about  the  Gaussian  scale-space,  see  the  aforementioned  references.) 

One  of  the  key  facts  that  can  be  gleaned  from  the  Gaussian  example,  is  that  the  scale- 
space  can  be  obtained  as  the  solution  of  a  partial  diflerential  equation  called  an  evolution 
equation.  This  idea  was  developed  in  different  works  for  evolution  equations  different  from 
the  classical  heat  equation.  In  what  follows,  we  will  describe  scale-spaces  for  planar  curves 
which  are  obtmned  as  solutions  of  nonlinear  evolution  equations. 

The  second  fundamental  concept  which  we  would  like  to  emphasize  is  that  of  invariant 
descriptor.  An  invariant  descriptor  is  a  property  of  an  object,  which  does  not  change  when  the 
object  undergoes  certmn  transformations.  More  precisely,  a  quantity  Q  is  called  an  invariant 
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of  a  Lie  group  Q  if  whenever  Q  transforms  into  ^  by  any  transformation  g  €  G,  yie  obtain 
Q  =  6Q,  where  6  is  a  function  of  g  alone.  If  @  =  1  for  all  p  €  (7,  Q  is  called  an  absolute 
invariant. 

For  example,  the  area  is  a  global  absolute  invariant  descriptor  of  the  Euclidean  group 
(rotations  and  translations)  for  planar  domains.  This  means  that  two  planar  domains  related 
by  an  Euclidean  motion  have  the  same  area.  The  well-known  Euclidean  curvature  given  as 
a  function  of  arc-length  is  a  local  absolute  invariant  of  the  Euclidean  group,  and  a  relative 
invariant  of  the  similarity  group.  We  should  add  that  the  development  of  invariants  of  viewing 
transformations  (Euclidean,  similarity,  affine,  and  projective  maps)  has  received  extended 
attention  from  the  computer  vision  community  in  the  last  years.  The  topic  is  very  important 
in  areas  such  as  object  recognition. 

A  special  class  of  invariants  is  given  by  the  differential  invariants  which  are  based  only 
on  local  information,  and  are  useful  for  the  representation  and  recognition  of  objects  under 
partial  occlusions.  An  example  of  this  kind  of  invariants  is  the  Euclidean  curvature  mentioned 
above.  The  theory  of  differential  invariants  is  classical  and  goes  back  at  least  to  the  work  of 
Gauss  on  Euclidean  geometry.  Much  of  the  recent  related  work  in  computer  vision  is  based 
on  those  old  theories.  In  our  work,  we  have  been  especially  interested  in  affine  differential 
invariants. 

The  third  component  of  our  work  comes  from  the  theory  of  plane  curve  evolution.  Here 
the  curve  regarded  as  the  boundary  of  a  planar  domain,  deforms  in  time.  This  defomation  is 
governed  by  a  partial,  usually  nonlinear,  evolution  equation.  Different  evolution  equations  can 
model  different  physical  phenomena,  such  as  crystal  growth,  the  Huygens  principle,  and  curve 
shortening  processes.  The  theory  has  been  well  studied  in  areas  such  as  computational  physics, 
difierential  geometry,  numerical  analysis,  and  parabolic  equations.  We  have  introduced  these 
ideas  into  computer  vision  in  [67,  68,  69]. 

Motivated  by  the  importance  of  affine  transformations  in  computer  vision,  a  new  theory 
of  affine  curve  evolution  was  recently  developed  [81,  82,  83,  84).  This  theory,  based  on  affine 
differential  geometry  and  the  theory  of  parabolic  evolution  equations,  constitutes  the  basis 
of  the  work  on  multi-scale  representations  of  signals  and  image  processing  in  general.  This  is 
based  in  turn  on  a  new  nonlinear  evolution  diffusion  equation  which  admits  affine  invariant 
solutions.  The  solution  of  this  evolution  equation  deternunes  an  affine  invariant  scale-space 
for  planar  curves.  Efficient  computer  implementation  of  this  theory  is  possible  due  to  a 
recently  developed  numerical  algorithm  for  curve  and  surface  evolution.  In  our  continuing 
AFOSR  research,  we  will  be  employing  these  algorithms  to  a  number  of  problems  in  active 
vision,  and  visual  control. 
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